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Remarks 

Claims 1-8 and 10-29 are pending in the application. Claims 1-8 and 10-29 are 
rejected. All rejections are respectfully traversed. 

Claims 1-3, 5-24 and 27 are rejected under 35 U.S.C. 102(b) as being anticipated 
by Ritchey, U.S. Patent No. 5,495,576 (Ritchey). 

Ritchey describes virtual model-based virtual image rendering. Visual information 
is acquired using a camera, and shape information is acquired using radar (column 
10, lines 17-25). Following acquisition of the sensor signals, Ritchey constructs a 
3D virtual model (see Abstract, "The computer processor integrates the sensor 
signals, processes signals as a virtual model. . and column 9, lines 6-14). 
Depending on the actions of a user, the 3D model is updated, for example, by 
moving a virtual object or changing the viewpoint of the display (column 9, lines 
46-58), and virtual images are generated from the virtual model and rendered on a 
display (column 20, lines 46-50). 

Ritchey generates a virtual model from sensor signals, and then generates virtual 
images from the virtual model. The claimed output video is generated from a 
compressed version of a video acquired of a dynamically changing scene. 

Regarding claim 1, Ritchey fails to teach the claimed producer modules configured 
to determine viewing parameters of the plurality of video cameras, in which the 
viewing parameters include a position, orientation, field-of-view, and focal plane, 
of each video camera. 
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As the displayed virtual images of Ritchey are entirely virtual model-based, there 
is no need for Ritchey to determine viewing parameters of video cameras, in which 
the viewing parameters include a position, orientation, field-of-view, and focal 
plane, of each video camera. All of the information Ritchey requires to display an 
image is determined by sampling the 3D model (column 2, lines 30-39). There is 
no mention of determining a position, orientation, field-of-view, or focal plane of a 
camera anywhere in Ritchey. At column 1 1, lines 55-61, and column 12, lines 1-9, 
Ritchey describes internal (intrinsic) camera parameters, such as chrominance, 
luminance, hue, and intensity, and additional hardware components that may be 
added to a camera. These are not viewing parameters, and certainly are not a 
position, orientation, field-of-view, and focal plane of each camera as claimed. 

In addition, Ritchey fails to teach the claimed plurality of consumer modules 
configured to generate a plurality of output videos from the decompressed videos 
according to the viewing parameters. 

As explained above, Ritchey fails to teach claimed producer modules configured to 
determine viewing parameters of the plurality of video cameras, in which the 
viewing parameters include a position, orientation, field-of-view, and focal plane, 
of each video camera. Therefore, Ritchey cannot teach a plurality of consumer 
modules configured to generate a plurality of output videos from the decompressed 
videos according to the viewing parameters. 

Furthermore, all of the information Ritchey requires to display his virtual image is 
determined by sampling the 3D virtual model. Depending on the actions of a user, 
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Ritchey updates and samples the 3D virtual model to determine what virtual 
images to display (column 20, lines 46-56). At column 22, lines 45-49, Ritchey 
describes determining a perspective projection relative to a user's head and eyes. 
This is not equivalent to generating a plurality of output videos according to the 
viewing parameters. As claimed, viewing parameters include position, orientation, 
field-of-view, and focal plane of each video camera used to acquire the videos, and 
not of a user viewing the videos. Ritchey cannot anticipate the claimed invention 

Regarding claim 2, Ritchey fails to teach a plurality of cameras configured to 
acquire calibration images displayed on the display surface of the three- 
dimensional display unit to determine the viewing parameters. At column 1 1, lines 
61-63, Ritchey describes compressing a plurality of images into a single frame. 
Examples of these single frames are shown in Figs. 9a, 9b, and 10 of Ritchey, see 
also column 12, lines 30-34 and lines 49-54. These images cannot be used to 
determine viewing parameters including position, orientation, field-of-view, and 
focal plane of each video camera. Additionally, these images are not calibration 
images. Calibration images, as known in the art, are used to compare a device or 
the output of an instrument to a standard having known measurement 
characteristics. In an embodiment of the invention, calibration images are used to 
determine viewing parameters for generating a plurality of output videos, see 
Specification, paragraphs [092]-[094]. There is nothing in Ritchey that teaches the 
use of calibration images as claimed. 

Regarding claims 3 and 5-8, Ritchey fails to teach the claimed producer modules 
configured to determine viewing parameters of the plurality of video cameras, in 
which the viewing parameters include a position, orientation, field-of-view, and 
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focal plane, of each video camera, and the claimed plurality of consumer modules 
configured to generate a plurality of output videos from the decompressed videos 
according to the viewing parameters. Therefore, Ritchey cannot anticipate the 
claimed invention further comprising the display units as claimed in claims 3 and 
5-8. 

Regarding claims 10-13, Ritchey fails to teach the claimed producer modules 
configured to determine viewing parameters of the plurality of video cameras, in 
which the viewing parameters include a position, orientation, field-of-view, and 
focal plane, of each video camera, and the claimed plurality of consumer modules 
configured to generate a plurality of output videos from the decompressed videos 
according to the viewing parameters. Therefore, Ritchey cannot anticipate the 
claimed invention further comprising the display of view-dependent images as 
claimed in claims 10-13. 

Regarding claim 14, Ritchey fails to teach the claimed producer modules 
configured to determine viewing parameters of the plurality of video cameras, in 
which the viewing parameters include a position, orientation, field-of-view, and 
focal plane, of each video camera, and the claimed plurality of consumer modules 
configured to generate a plurality of output videos from the decompressed videos 
according to the viewing parameters. Therefore, Ritchey cannot anticipate the 
claimed invention further comprising producer modules connected to a subset of 
the plurality of video cameras as claimed in claim 14. 

Regarding claims 15-17, Ritchey fails to teach the claimed producer modules 
configured to determine viewing parameters of the plurality of video cameras, in 
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which the viewing parameters include a position, orientation, field-of-view, and 
focal plane, of each video camera, and the claimed plurality of consumer modules 
configured to generate a plurality of output videos from the decompressed videos 
according to the viewing parameters. Therefore, Ritchey cannot anticipate the 
claimed invention further comprising the arrangement of video cameras as claimed 
in claims 15-17. 

Furthermore, the cameras depicted in Fig. 17 are not in a regularly spaced linear 
and horizontal array as claimed in claim 15. Each camera in that figure is shown to 
be acquiring a different side of an object, see "Side A" through "Side F" clearly 
marked in Figure 17; column 10, lines 32-34; and Fig. 6. This is impossible with a 
regularly spaced linear and horizontal array as claimed in claim 15. 

At column 12, lines 44-47, Ritchey describes optical fiber bundles used to transmit 
images "of various sides of the subject" (see lines 32-34) to the light sensitive 
recording surface of a camera. Acquiring images of various sides of an object, as 
described in Ritchey, requires a camera arrangement that can receive light from all 
sides of an object. This cannot be done with the camera arrangement as claimed in 
claim 17. Although the fiber optic cables can be twisted to achieve the described 
alignment for the cables themselves, this does not teach an optical axis of each 
video camera perpendicular to a common plane, and the up vectors of the plurality 
of video cameras being vertically aligned as claimed in claim 17. Again, it is clear 
that Ritchey does not describe a linear or quasi-linear array of cameras as claimed. 

Regarding claim 18, Ritchey fails to teach the claimed producer modules 
configured to determine viewing parameters of the plurality of video cameras, in 



12 



MERL-1538 
Pfistcretal. 
10/783,542 

which the viewing parameters include a position, orientation, field-of-view, and 
focal plane, of each video camera, and the claimed plurality of consumer modules 
configured to generate a plurality of output videos from the decompressed videos 
according to the viewing parameters. Therefore, Ritchey cannot anticipate the 
claimed invention further comprising the viewing parameters as claimed in claim 
18. Furthermore, as explained above, Ritchey does not teach extrinsic parameters, 
Le. 9 parameters determined by camera placement as opposed to internal parameters 
determined by camera hardware, at column 11, lines 55-63, and column 12, lines 
3-11. 

Regarding claim 19, Ritchey fails to teach the claimed producer modules 
configured to determine viewing parameters of the plurality of video cameras, in 
which the viewing parameters include a position, orientation, field-of-view, and 
focal plane, of each video camera, and the claimed plurality of consumer modules 
configured to generate a plurality of output videos from the decompressed videos 
according to the viewing parameters. Therefore, Ritchey cannot anticipate the 
claimed invention further comprising the selection of a subset of cameras as 
claimed in claim 19. 

Regarding claim 20, Ritchey fails to teach the claimed producer modules 
configured to determine viewing parameters of the plurality of video cameras, in 
which the viewing parameters include a position, orientation, field-of-view, and 
focal plane, of each video camera, and the claimed plurality of consumer modules 
configured to generate a plurality of output videos from the decompressed videos 
according to the viewing parameters. Therefore, Ritchey cannot anticipate the 
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claimed invention further comprising the compression of videos as claimed in 
claim 20. 

Regarding claims 22-24, Ritchey fails to teach the claimed producer modules 
configured to determine viewing parameters of the plurality of video cameras, in 
which the viewing parameters include a position, orientation, field-of-view, and 
focal plane, of each video camera, and the claimed plurality of consumer modules 
configured to generate a plurality of output videos from the decompressed videos 
according to the viewing parameters. Therefore, Ritchey cannot anticipate the 
claimed invention further comprising the output pixel processing as claimed in 
claims 22-24. 

Regarding claim 27, Ritchey fails to teach the claimed producer modules 
configured to determine viewing parameters of the plurality of video cameras, in 
which the viewing parameters include a position, orientation, field-of-view, and 
focal plane, of each video camera, and the claimed plurality of consumer modules 
configured to generate a plurality of output videos from the decompressed videos 
according to the viewing parameters. Therefore, Ritchey cannot anticipate the 
claimed invention further comprising the arrangement of video cameras and 
display unit as claimed in claim 27. 

Claim 4 is rejected under 35 U.S.C. 103(a) as being unpatentable over Ritchey. 

Regarding claim 4, Ritchey fails to teach the claimed producer modules configured 
to determine viewing parameters of the plurality of video cameras, in which the 
viewing parameters include a position, orientation, field-of-view, and focal plane, 



14 



MERL-1538 
Pfistcretal. 
10/783,542 

of each video camera, and the claimed plurality of consumer modules configured 
to generate a plurality of output videos from the decompressed videos according to 
the viewing parameters. Therefore, Ritchey cannot anticipate the claimed invention 
further comprising organic light emitting diodes as claimed in claim 4. 

Claims 25 and 26 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Ritchey, in view of Ezra et al., U.S. Patent No. 5/703,717 (Ezra). 

Regarding claims 25 and 26, the combination of Ritchey and Ezra fails to teach the 
claimed producer modules configured to determine viewing parameters of the 
plurality of video cameras, in which the viewing parameters include a position, 
orientation, field-of-view, and focal plane, of each video camera, and the claimed 
plurality of consumer modules configured to generate a plurality of output videos 
from the decompressed videos according to the viewing parameters. Therefore, 
Ritchey cannot anticipate the claimed invention further comprising the lenticular 
display units as claimed in claims 25 and 26. 

Claims 28 and 29 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Ritchey, in view of Nayar et al., U.S. Patent Application Publication No. 
2004/0070565 (Nayar). 

Regarding claims 28 and 29, the combination of Ritchey and Nayar fails to teach 
the claimed producer modules configured to determine viewing parameters of the 
plurality of video cameras, in which the viewing parameters include a position, 
orientation, field-of-view, and focal plane, of each video camera, and the claimed 
plurality of consumer modules configured to generate a plurality of output videos 
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from the decompressed videos according to the viewing parameters. Therefore, 
Ritchey cannot anticipate the claimed invention further comprising the acquisition 
and display of high dynamic lightfields as claimed in claims 28 and 29. 



It is believed that this application is now in condition for allowance. A notice to 
this effect is respectfully requested. Should further questions arise concerning this 
application, the Examiner is invited to call Applicant's attorney at the number 
listed below. Please charge any shortage in fees due in connection with the filing of 
this paper to Deposit Account 50-0749 . 



Respectfully submitted, 
/Clifton D. Mueller/ 



Clifton D. Mueller 
Attorney for the Assignee 
Reg. No. 57,836 

Mitsubishi Electric Research Laboratories, Inc. 
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Cambridge, MA 02 139 
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